Ambient Intelligent Multimodal Learning Environment for Children

Multimodality has real potential to improve interaction between computers and people. Research in the fields of pervasive computing and ambient intelligence has resulted in multimodal interfaces that enable the communication between technology and people to be more natural and efficient. Pervasive technologies, such as the Personal Digital Assistant (PDA) and smart phones are prime examples of where multimodal interfaces are of benefit, however these devices are rarely used by children for educational use. With many organisations ‘harnessing technology’ for educational and entertaining purposes, there is a growing field of edutainment software for children. The combined use of a multimodal interface based on a PDA with an edutainment application would allow a rich experience of collaborative learning where the task is not restricted to a physical location provided by a traditional desktop PC. This research aims to investigate the use of a PDA-based generic multimodal interface to facilitate children’s education. Paying particular attention to the interaction between children and technology, this research also aims to provide guidelines for children’s usability of mobile devices and multimodal interaction. The proposed system called AmbiLearn is a PDAbased multimodal system to enhance children’s learning. The multimodality of the system will enable the user to use a combination of speech and pen as inputs and offer rich feedback through the use of speech, graphics and an embodied agent. Appropriate software tools are investigated with regard to the development of AmbiLearn. A research plan is outlined in the form of a Gantt chart and AmbiLearn is compared to similar systems using a range of key criteria. Focusing on multimodal input and output, it is expected that AmbiLearn will support collaborative learning and advance upon existing mobile interfaces improving interaction. In order to test and evaluate AmbiLearn, an educational application in the form of a serious game will be developed, e.g. a treasure hunt game/puzzles. Usability tests will be conducted with a range of children from different schools in the primary education sector.